00010000:00010000:0.0F:1787096524.494629:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1787096524.494630:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7bedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360227072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096524.494742:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096524.494802:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227072 00000100:00100000:0.0:1787096524.494813:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227072 00000100:00100000:0.0:1787096524.494881:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787096524.494892:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360227072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787096524.494937:0:7723:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787096524.495014:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360227072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096524.495035:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787096524.495070:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7bedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360227072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0F:1787096524.938491:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096524.938531:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352825728 00000100:00100000:0.0:1787096524.938542:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352825728 00000100:00100000:0.0:1787096524.938597:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:0.0:1787096524.938608:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7bedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:26788:x1873906352825728:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:0.0:1787096524.938632:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096524.938654:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6b67 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.938712:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43a47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.938727:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43a47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.938736:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43a47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096524.938771:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096524.938775:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096524.938792:0:6480:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43a47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.938828:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b67 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.938844:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43a47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b67 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.938853:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35c900) 00010000:00010000:0.0:1787096524.938856:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096524.938860:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceaa00, rc 0) 00000100:00100000:0.0:1787096524.938908:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7bedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:26788:x1873906352825728:12345-192.168.203.27@tcp:101:rm.0 Request processed in 303us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096524.938914:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:2.0:1787096524.940001:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096524.940046:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352825856 00000100:00100000:0.0:1787096524.940052:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352825856 00000100:00100000:0.0:1787096524.940087:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 127 00000100:00100000:0.0:1787096524.940095:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7bed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:26788:x1873906352825856:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:0.0:1787096524.940107:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096524.940117:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6b6e expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940151:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940162:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940170:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940188:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940196:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940204:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940257:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b43a63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940263:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b43a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940267:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b43a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096524.940285:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 0 00000004:00200000:0.0:1787096524.940287:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096524.940296:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b43a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940304:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b43a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940312:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940319:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940335:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940341:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096524.940344:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940351:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940361:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35c900) 00010000:00010000:0.0:1787096524.940363:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096524.940366:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940372:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940382:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940388:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940411:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940417:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096524.940421:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940437:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940448:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fc0c961 (ffff9c9c41b55700) 00010000:00010000:0.0:1787096524.940451:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096524.940454:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940460:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b43a5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940482:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccebe00/0x1b9fb40e15b43a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b6e expref: 11 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940493:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b43a63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b6e expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096524.940499:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9c9d6b35c100) 00010000:00010000:0.0:1787096524.940501:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096524.940504:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceb200, rc 0) 00000100:00100000:0.0:1787096524.940533:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7bed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:26788:x1873906352825856:12345-192.168.203.27@tcp:101:rm.0 Request processed in 440us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096524.940540:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 127 00000100:00100000:2.0:1787096524.942200:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0F:1787096524.942242:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352826112 00000100:00100000:3.0:1787096524.942255:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352826112 00000100:00100000:3.0:1787096524.942299:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:3.0:1787096524.942308:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7bedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:26788:x1873906352826112:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:3.0:1787096524.942345:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787096524.942363:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b43a63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b6e expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942377:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9c9d6b35c100) 00010000:00010000:3.0:1787096524.942389:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43a47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b67 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942448:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35c900) 00010000:00010000:3.0:1787096524.942457:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096524.942473:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942482:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942490:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942500:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b43a71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942507:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b43a71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942514:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b43a71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942583:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942592:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942599:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942759:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942768:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942776:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942783:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942789:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942795:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942813:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096524.942827:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942833:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942846:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942851:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096524.942854:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942861:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942870:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:3.0:1787096524.942874:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096524.942877:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942883:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43a78 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942897:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942904:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942919:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942928:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096524.942930:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942948:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942955:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b3f0b00) 00010000:00010000:3.0:1787096524.942957:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096524.942960:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942966:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096524.942983:0:6479:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009ba5fa08 reply state 0000000092109b6c transno 4294967349 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b43a71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942993:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b43a71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7fc0c961 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.942999:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7fc0c961 (ffff9c9c41b55700) 00010000:00010000:3.0:1787096524.943002:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096524.943005:0:6479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787096524.943073:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7bedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:26788:x1873906352826112:12345-192.168.203.27@tcp:36:rm.0 Request processed in 766us (875us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787096524.943080:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 128 00010000:00010000:3.0:1787096524.943108:0:6469:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096524.943113:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.943120:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3e00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:3.0:1787096524.943123:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.943140:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.943149:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:3.0:1787096524.943152:0:6469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096524.943156:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.943161:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a7f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096524.943173:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096524.943175:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096524.943178:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096525.006557:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3625:1873906360227200:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.006629:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096525.006680:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1873906360227712:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.006706:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096525.006730:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1873906360228224:0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.006742:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1873906360227328:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.006755:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096525.006784:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227712 00000100:00100000:0.0:1787096525.006793:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227712 00000100:00100000:2.0:1787096525.006808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096525.006836:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1873906360227840:0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.006848:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360228224 00000100:00100000:0.0:1787096525.006853:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360228224 00000100:00100000:2.0:1787096525.006863:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096525.006882:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1873906360228352:0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.006885:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227328 00000100:00100000:0.0:1787096525.006889:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227328 00000100:00100000:1.0:1787096525.006904:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227840 00000100:00100000:2.0:1787096525.006910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096525.006912:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227840 00000100:00100000:0.0:1787096525.006916:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360228352 00000100:00100000:0.0:1787096525.006921:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360228352 00000100:00100000:2.0:1787096525.006943:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360227584:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.006951:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787096525.006963:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787096525.006964:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1873906360227712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.006977:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096525.006978:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1873906360228224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.007004:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360228096:0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.007048:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1873906360228224:12345-0@lo:400:kworker.0 Request processed in 75us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096525.007055:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1873906360227712:12345-0@lo:400:kworker.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096525.007057:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096525.007058:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787096525.007069:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787096525.007081:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787096525.007090:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1873906360227328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.007093:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360228608:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.007104:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787096525.007114:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1873906360227840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.007124:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096525.007149:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787096525.007157:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1873906360227456:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.007162:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1873906360227840:12345-0@lo:400:kworker.0 Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096525.007170:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787096525.007188:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787096525.007196:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096525.007200:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1873906360228352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.007201:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1873906360227328:12345-0@lo:400:kworker.0 Request processed in 108us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096525.007213:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1787096525.007215:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096525.007216:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360227968:0@lo:400:kworker.0 00000100:00080000:3.0:1787096525.007220:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096525.007233:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227456 00000100:00100000:3.0:1787096525.007238:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227456 00000100:00100000:1.0:1787096525.007241:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1873906360228352:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096525.007249:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096525.007260:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787096525.007271:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360228480:0@lo:400:kworker.0 00000100:00100000:3.0:1787096525.007272:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787096525.007282:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1873906360227456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.007303:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096525.007309:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1873906360227712:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.007328:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1873906360228224:0@lo:400:kworker.0 00000100:00100000:3.0:1787096525.007329:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1873906360227456:12345-0@lo:400:kworker.0 Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096525.007335:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787096525.007342:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1873906360227456:0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.007372:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360228096 00000100:00100000:1.0:1787096525.007378:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360228608 00000100:00100000:0.0:1787096525.007378:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360228096 00000100:00100000:1.0:1787096525.007383:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360228608 00000100:00100000:2.0:1787096525.007386:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1873906360227328:0@lo:400:kworker.0 00010000:00080000:2.0:1787096525.007428:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d75980000 x1873906360227840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096525.007437:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227968 00000100:00100000:1.0:1787096525.007437:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360228480 00000100:00100000:3.0:1787096525.007442:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227968 00000100:00100000:1.0:1787096525.007442:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360228480 00000100:00100000:0.0:1787096525.007447:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787096525.007451:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1873906360227840:0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.007460:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360228608:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787096525.007467:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d75983b80 x1873906360228352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096525.007472:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787096525.007482:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787096525.007483:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1873906360228352:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.007484:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360228096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096525.007491:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360227968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.007512:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360228608:12345-0@lo:400:kworker.0 Request processed in 56us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096525.007515:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360228864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096525.007521:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787096525.007530:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360227968:12345-0@lo:400:kworker.0 Request processed in 40us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096525.007530:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360228096:12345-0@lo:400:kworker.0 Request processed in 47us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096525.007538:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787096525.007550:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787096525.007554:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096525.007558:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787096525.007563:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360228480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.007575:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360228736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096525.007595:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360228864 00000100:00100000:2.0:1787096525.007601:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360228864 00000100:00100000:1.0:1787096525.007608:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096525.007615:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360228480:12345-0@lo:400:kworker.0 Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096525.007623:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787096525.007637:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360227968:0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.007640:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360228736 00000100:00100000:2.0:1787096525.007644:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360228736 00010000:00080000:3.0:1787096525.007651:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d75980a80 x1873906360228480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096525.007654:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787096525.007659:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227584 00000100:00100000:3.0:1787096525.007663:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360228480:0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.007664:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360228864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096525.007664:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227584 00000100:00100000:2.0:1787096525.007670:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787096525.007681:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360228096:0@lo:400:kworker.0 00000100:00100000:2.0:1787096525.007683:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360228736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787096525.007688:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096525.007696:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1787096525.007697:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d75983100 x1873906360228608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1787096525.007698:0:8362:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096525.007712:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360228608:0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.007717:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360227584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096525.007729:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360228864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096525.007736:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787096525.007752:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360228736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096525.007760:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1787096525.007766:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9c42e61880 x1873906360228864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096525.007774:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360227584:12345-0@lo:400:kworker.0 Request processed in 60us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096525.007782:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360227200 00000100:00100000:1.0:1787096525.007786:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360227200 00000100:00100000:3.0:1787096525.007787:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360228864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096525.007787:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1787096525.007800:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9c42e62a00 x1873906360228736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096525.007816:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360228736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096525.007824:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787096525.007832:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3625:x1873906360227200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096525.007837:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360227584:0@lo:400:kworker.0 00000100:00080000:2.0:1787096525.007861:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787096525.007866:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096525.007873:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3625:x1873906360227200:12345-0@lo:400:kworker.0 Request processed in 40us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096525.007885:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787096525.007888:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3625:1873906360227200:0@lo:400:kworker.0 00010000:00010000:0.0:1787096525.518555:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096525.523579:0:19406:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6e: Write fails when only parity mirror is non-stale ========================================================== 19:42:05 (1787096525) 00000100:00100000:0.0:1787096525.585708:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096525.585739:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352826240 00000100:00100000:0.0:1787096525.585747:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352826240 00000100:00100000:0.0:1787096525.585822:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:0.0:1787096525.585833:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d748ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:26957:x1873906352826240:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096525.585856:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096525.585878:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6b75 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.585940:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.585957:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.585973:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096525.586037:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096525.586042:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096525.586061:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.586100:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b75 expref: 12 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.586117:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b75 expref: 11 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.586124:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35cd00) 00010000:00010000:0.0:1787096525.586126:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096525.586129:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ccea600, rc 0) 00000100:00100000:0.0:1787096525.586186:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d748ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:26957:x1873906352826240:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 355us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096525.586192:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00080000:0.0:1787096525.586219:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096525.587451:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096525.587483:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352826368 00000100:00100000:3.0:1787096525.587488:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352826368 00000100:00100000:3.0:1787096525.587528:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:3.0:1787096525.587538:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:26957:x1873906352826368:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096525.587551:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096525.587565:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6b7c expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587622:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587634:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587644:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587659:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587666:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587674:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587703:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587710:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587717:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587724:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096525.587728:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587746:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587759:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35cd00) 00010000:00010000:3.0:1787096525.587762:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096525.587766:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587773:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587785:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587790:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587796:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587801:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096525.587805:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587811:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587819:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd21bc93c (ffff9c9d6b3f0b00) 00010000:00010000:3.0:1787096525.587821:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096525.587824:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587841:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43aa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587872:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b7c expref: 12 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587883:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35cd00) 00010000:00010000:3.0:1787096525.587885:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096525.587890:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b43a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b7c expref: 12 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.587899:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2400, rc 0) 00000100:00100000:3.0:1787096525.587934:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:26957:x1873906352826368:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 400us (487us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096525.587939:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:1.0:1787096525.589926:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096525.589967:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352826624 00000100:00100000:3.0:1787096525.589975:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352826624 00000100:00100000:3.0:1787096525.590032:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:3.0:1787096525.590042:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:26957:x1873906352826624:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096525.590058:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096525.590061:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787096525.590079:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea600/0x1b9fb40e15b43a8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b75 expref: 11 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590094:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35cd00) 00010000:00010000:3.0:1787096525.590103:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096525.590125:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43aa9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6b83 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590198:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590210:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590220:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590231:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43ab7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590238:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590245:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590784:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590796:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590803:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096525.590813:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 0 00010000:00010000:3.0:1787096525.590836:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590854:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590861:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590867:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2a00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096525.590871:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590879:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590890:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b3f0900) 00010000:00010000:3.0:1787096525.590894:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096525.590898:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590903:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43ab0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096525.590917:0:6479:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f6c1b09e reply state 000000008837a161 transno 4294967350 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590927:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43ab7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590934:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd21bc93c (ffff9c9d6b3f0c00) 00010000:00010000:3.0:1787096525.590937:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096525.590939:0:6479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096525.590965:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43aa9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.590992:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.591003:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c9d6b3f0300) 00010000:00010000:3.0:1787096525.591006:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096525.591009:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2c00, rc 0) 00000100:00100000:3.0:1787096525.591082:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:26957:x1873906352826624:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1041us (1159us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787096525.591091:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:0.0:1787096525.592706:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096525.592741:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352826880 00000100:00100000:1.0:1787096525.592749:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352826880 00000100:00100000:1.0:1787096525.592796:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:1.0:1787096525.592807:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:26957:x1873906352826880:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096525.592829:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096525.592843:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43acc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6b8a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096525.592910:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096525.592923:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096525.592930:0:6480:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096525.592957:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096525.592981:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 14 pid: 6479 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096525.592991:0:6480:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6480:1873906360228992:192.168.203.27@tcp:104: 00000100:00100000:1.0:1787096525.593086:0:6480:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d58952240 going to sleep for 11 seconds 00000100:00100000:3.0:1787096525.594069:0:6480:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6480:1873906360228992:192.168.203.27@tcp:104: 00010000:00010000:3.0:1787096525.594089:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096525.594495:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096525.594537:0:9435:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352827008 00000100:00100000:3.0:1787096525.594543:0:9435:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352827008 00010000:00010000:3.0:1787096525.594615:0:9435:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 15 pid: 6479 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096525.594655:0:9435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:3.0:1787096525.594667:0:9435:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:2401:x1873906352827008:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096525.594679:0:9435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096525.594686:0:9435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 15 pid: 6479 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.594700:0:9435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 15 pid: 6479 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.594727:0:9435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43abe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b83 expref: 15 pid: 6479 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.594743:0:9435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c9d6b3f0300) 00010000:00010000:3.0:1787096525.594748:0:9435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.594755:0:9435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.594763:0:9435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096525.594792:0:9435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096525.594815:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.594822:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096525.594833:0:9435:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:2401:x1873906352827008:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 169us (340us total) trans 0 rc 0/0 00000004:00200000:0.0:1787096525.594834:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 0 00000100:00100000:3.0:1787096525.594846:0:9435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00010000:00010000:0.0:1787096525.594956:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.594962:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.594966:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.594976:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9ce600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096525.594980:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.594985:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.594994:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c9d6b3f0300) 00010000:00010000:0.0:1787096525.594996:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787096525.594999:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.595003:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ad3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.595051:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43acc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b8a expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.595059:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286f00) 00010000:00010000:0.0:1787096525.595061:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096525.595065:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43acc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6b8a expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096525.595083:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cec00, rc 0) 00000100:00100000:0.0:1787096525.595116:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:26957:x1873906352826880:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2312us (2413us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096525.595125:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:0.0:1787096525.596347:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096525.596385:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352827264 00000100:00100000:1.0:1787096525.596452:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352827264 00000100:00100000:1.0:1787096525.596479:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:1.0:1787096525.596485:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:26957:x1873906352827264:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1787096525.596622:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:26957:x1873906352827264:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 136us (276us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1787096525.596627:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1787096526.030842:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360229120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096526.030916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096526.031079:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360229120 00000100:00100000:2.0:1787096526.031088:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360229120 00000100:00100000:2.0:1787096526.031160:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787096526.031170:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360229120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096526.031205:0:7409:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787096526.031257:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360229120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096526.031265:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787096526.031304:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360229120:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787096526.089603:0:19454:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6e: @@@@@@ FAIL: create EC file failed 00010000:00010000:0.0:1787096526.542492:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 461 lines, 461 kept, 0 dropped, 0 bad.