00000100:00100000:2.0F:1787096514.255523:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0F:1787096514.255535:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096514.255550:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7dad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360222080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787096514.256737:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096514.256784:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222080 00000100:00100000:0.0:1787096514.256792:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222080 00000100:00100000:0.0:1787096514.256844:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787096514.256855:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360222080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787096514.256891:0:6485:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787096514.256973:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360222080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096514.256980:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787096514.257014:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7dad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360222080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0F:1787096514.288928:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0F:1787096514.290610:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352818432 00000100:00100000:1.0:1787096514.290627:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352818432 00000100:00100000:1.0:1787096514.290795:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:1.0:1787096514.290806:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:24119:x1873906352818432:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1787096514.290825:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096514.290901:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b437d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6abf expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787096514.290903:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787096514.290960:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b437df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.290972:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b437df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.290983:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b437df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096514.291018:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096514.291022:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096514.291040:0:6479:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b437df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.291061:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b437d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6abf expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.291074:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b437df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6abf expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.291083:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286c00) 00010000:00010000:1.0:1787096514.291099:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096514.291102:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cf800, rc 0) 00000100:00100000:1.0:1787096514.291713:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:24119:x1873906352818432:12345-192.168.203.27@tcp:101:rm.0 Request processed in 908us (2796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096514.291720:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:2.0:1787096514.293696:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096514.293747:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352818560 00000100:00100000:0.0:1787096514.293754:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352818560 00000100:00100000:0.0:1787096514.293790:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:0.0:1787096514.293797:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:24119:x1873906352818560:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:0.0:1787096514.293812:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096514.293823:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b437e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ac6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.293861:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.293877:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.293887:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.293901:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.293908:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.293941:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294022:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b437fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294030:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b437fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294037:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b437fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096514.294067:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787096514.294070:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096514.294094:0:6480:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b437fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294105:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b437fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294112:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294118:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294125:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294131:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceb800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096514.294135:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294149:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294162:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286c00) 00010000:00010000:0.0:1787096514.294164:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096514.294168:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294174:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b437ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294184:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294189:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294195:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294199:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096514.294202:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294208:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294216:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x328fd2b2 (ffff9c9d6b35cf00) 00010000:00010000:0.0:1787096514.294219:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096514.294222:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294237:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b437f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294259:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b437e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ac6 expref: 13 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294270:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b437fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ac6 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096514.294278:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c9d6b35c600) 00010000:00010000:0.0:1787096514.294280:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096514.294282:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ccea800, rc 0) 00000100:00100000:0.0:1787096514.294327:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:24119:x1873906352818560:12345-192.168.203.27@tcp:101:rm.0 Request processed in 529us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096514.294334:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:0.0:1787096514.296624:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096514.296689:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352818816 00000100:00100000:2.0:1787096514.296697:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352818816 00000100:00100000:2.0:1787096514.296744:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:2.0:1787096514.296757:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:24119:x1873906352818816:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:2.0:1787096514.296803:0:7414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787096514.296823:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b437fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ac6 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.296837:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c9d6b35c600) 00010000:00010000:2.0:1787096514.296858:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b437df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6abf expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.296899:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286c00) 00010000:00010000:2.0:1787096514.296908:0:7414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096514.297082:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297144:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297152:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297161:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43809 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297172:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43809 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297176:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43809 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297238:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297246:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297253:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297460:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297469:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297477:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297484:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297491:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297497:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297532:0:7414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096514.297550:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.297553:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096514.297560:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297560:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297579:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297586:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ac00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096514.297590:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b400 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:2.0:1787096514.297590:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.297598:0:8376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297601:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.297611:0:8376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297616:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c9c41b55400) 00010000:00010000:2.0:1787096514.297626:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096514.297631:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.297635:0:8376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c9c41b55400) 00010000:00010000:2.0:1787096514.297638:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43810 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.297646:0:8376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096514.297651:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297657:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.297658:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b43817 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297672:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297678:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297691:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ba00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096514.297692:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096514.297695:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.297696:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096514.297699:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096514.297713:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297723:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55500) 00010000:00010000:2.0:1787096514.297725:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096514.297729:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297734:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b43802 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096514.297748:0:7414:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007c34b080 reply state 000000007798e69f transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43809 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297758:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43809 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.297764:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x328fd2b2 (ffff9c9d6b35cf00) 00010000:00010000:2.0:1787096514.297767:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096514.297770:0:7414:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096514.297837:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:24119:x1873906352818816:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1082us (1219us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787096514.298036:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:3.0:1787096514.768529:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787096514.768550:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d512d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360222208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096514.768612:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096514.768657:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787096514.768667:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d759c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360222336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096514.768695:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096514.768724:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222208 00000100:00100000:3.0:1787096514.768731:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222208 00000100:00100000:3.0:1787096514.768779:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222336 00000100:00100000:3.0:1787096514.768788:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222336 00000100:00100000:3.0:1787096514.768813:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787096514.768823:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d759c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360222208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096514.768851:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096514.768906:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d759c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360222208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096514.768913:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787096514.768940:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787096514.768949:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d759c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360222336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787096514.768960:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096514.768993:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d759c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360222336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096514.769001:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1787096514.769040:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d759c2a00 x1873906360222336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096514.769056:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d759c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360222336:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787096514.769143:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096514.769506:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906360222848:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.769553:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.769576:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360223360:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.769603:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.769626:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787096514.769634:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360222464:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.769663:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.769684:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360222976:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.769711:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.769725:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360223488:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.769742:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.769771:0:8580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360223360 00000100:00100000:2.0:1787096514.769775:0:8580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360223360 00000100:00100000:2.0:1787096514.769802:0:8580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360223488 00000100:00100000:2.0:1787096514.769804:0:8580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360223488 00000100:00100000:2.0:1787096514.769817:0:8580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787096514.769821:0:8580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360223360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096514.769844:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222848 00000100:00100000:2.0:1787096514.769849:0:8580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360223360:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096514.769850:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222848 00000100:00100000:2.0:1787096514.769855:0:8580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787096514.769866:0:8580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787096514.769871:0:8580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360223488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096514.769894:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787096514.769895:0:8580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360223488:12345-0@lo:400:kworker.0 Request processed in 24us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.769906:0:8580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787096514.769908:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906360222848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.769926:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222464 00000100:00100000:2.0:1787096514.769930:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222464 00000100:00100000:1.0:1787096514.769958:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906360222848:12345-0@lo:400:kworker.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096514.769967:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787096514.769973:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787096514.769977:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1873906360222592:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.769982:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360222464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096514.770020:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.770026:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360222464:12345-0@lo:400:kworker.0 Request processed in 45us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.770032:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787096514.770051:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1873906360223104:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770066:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222976 00000100:00100000:2.0:1787096514.770071:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222976 00000100:00100000:3.0:1787096514.770081:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.770108:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787096514.770114:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360222976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096514.770156:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1873906360223616:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770156:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360222976:12345-0@lo:400:kworker.0 Request processed in 41us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.770168:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787096514.770191:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096514.770213:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222592 00000100:00100000:2.0:1787096514.770218:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222592 00010000:00080000:3.0:1787096514.770223:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d512d0700 x1873906360222208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096514.770239:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d512d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360222208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096514.770244:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360223104 00000100:00100000:2.0:1787096514.770248:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360223104 00000100:00100000:3.0:1787096514.770272:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787096514.770277:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360223616 00000100:00100000:2.0:1787096514.770281:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360223616 00000100:00100000:3.0:1787096514.770292:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360222720:0@lo:400:kworker.0 00000100:00100000:0.0:1787096514.770312:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787096514.770321:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787096514.770326:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d759c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1873906360222592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770336:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d759c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1873906360223104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096514.770343:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096514.770369:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1873906360223232:0@lo:400:kworker.0 00000100:00100000:0.0:1787096514.770376:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d759c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1873906360222592:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096514.770384:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787096514.770389:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d759c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1873906360223104:12345-0@lo:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.770414:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787096514.770421:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096514.770429:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360223232 00000100:00100000:0.0:1787096514.770434:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360223232 00000100:00100000:2.0:1787096514.770439:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787096514.770449:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d759c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1873906360223616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096514.770450:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1873906360223744:0@lo:400:kworker.0 00000100:00100000:0.0:1787096514.770462:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787096514.770472:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1873906360223232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770497:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d759c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1873906360223616:12345-0@lo:400:kworker.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096514.770505:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096514.770516:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1873906360223232:12345-0@lo:400:kworker.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.770518:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787096514.770531:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787096514.770536:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360223744 00000100:00100000:3.0:1787096514.770540:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1873906360222592:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770542:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360223744 00000100:00100000:3.0:1787096514.770567:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1873906360223104:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770579:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787096514.770583:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1873906360223616:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770589:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1873906360223744:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787096514.770611:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d748eed80 x1873906360223232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096514.770623:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1873906360223232:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770624:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1873906360223744:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.770634:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00010000:00080000:3.0:1787096514.770643:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d748ee300 x1873906360223744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096514.770653:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1873906360223744:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770654:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360222720 00000100:00100000:2.0:1787096514.770659:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360222720 00000100:00100000:2.0:1787096514.770684:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787096514.770691:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360222720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770725:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360222720:12345-0@lo:400:kworker.0 Request processed in 35us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.770732:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787096514.770739:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360222720:0@lo:400:kworker.0 00000100:00080000:2.0:1787096514.770756:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787096514.770760:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787096514.770763:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096514.770909:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360222464:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770924:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360222976:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770937:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360223488:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770947:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906360222848:0@lo:400:kworker.0 00000100:00100000:2.0:1787096514.770958:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360223360:0@lo:400:kworker.0 00000001:02000400:0.0:1787096514.892354:0:18327:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 19:41:55 (1787096515) 00000100:00100000:2.0:1787096514.959690:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096514.959735:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352818944 00000100:00100000:2.0:1787096514.959744:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352818944 00000100:00100000:2.0:1787096514.959797:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:2.0:1787096514.959808:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d748b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:24278:x1873906352818944:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096514.959831:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096514.959854:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b4381e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6acd expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.959916:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b43825 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.959930:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b43825 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.959944:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b43825 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096514.959979:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096514.959983:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096514.960001:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b43825 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.960026:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b4381e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6acd expref: 14 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.960043:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b43825 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6acd expref: 13 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.960053:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55500) 00010000:00010000:2.0:1787096514.960057:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096514.960071:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4a800, rc 0) 00000100:00100000:2.0:1787096514.960138:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d748b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:24278:x1873906352818944:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 331us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096514.960145:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:3.0:1787096514.961969:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096514.961996:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352819072 00000100:00100000:3.0:1787096514.962003:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352819072 00000100:00100000:3.0:1787096514.962040:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 102 00000100:00100000:3.0:1787096514.962047:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:24278:x1873906352819072:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096514.962066:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096514.962077:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b4382c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ad4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962136:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962145:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962152:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962162:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962167:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962171:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962207:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962214:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962220:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962227:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3c00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096514.962237:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962244:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962253:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55500) 00010000:00010000:3.0:1787096514.962257:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096514.962260:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962266:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b43833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962278:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962284:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962291:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962296:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2c00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096514.962299:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962305:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962313:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57a32597 (ffff9c9d6b3f0e00) 00010000:00010000:3.0:1787096514.962315:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096514.962322:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962326:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b4383a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962350:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b4382c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ad4 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962356:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55500) 00010000:00010000:3.0:1787096514.962358:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096514.962360:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b4382c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ad4 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.962365:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2800, rc 0) 00000100:00100000:3.0:1787096514.962453:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:24278:x1873906352819072:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 407us (487us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096514.962458:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 102 00000100:00100000:2.0:1787096514.964425:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096514.964469:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352819328 00000100:00100000:3.0:1787096514.964477:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352819328 00000100:00100000:3.0:1787096514.964533:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:3.0:1787096514.964545:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d748bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:24278:x1873906352819328:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096514.964562:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096514.964564:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787096514.964587:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b43825 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6acd expref: 13 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.964601:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55500) 00010000:00010000:3.0:1787096514.964610:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096514.964626:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b43841 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6adb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.964695:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.964706:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.964716:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.964726:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b4384f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.964732:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b4384f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.964737:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b4384f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965097:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965106:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965113:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096514.965122:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 0 00010000:00010000:3.0:1787096514.965152:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965170:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965176:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965182:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096514.965186:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965201:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965214:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b3f0f00) 00010000:00010000:3.0:1787096514.965217:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096514.965221:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965226:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b43848 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096514.965237:0:6479:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c5f8e984 reply state 00000000ec6488f3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b4384f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965247:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b4384f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965253:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57a32597 (ffff9c9d6b3f0600) 00010000:00010000:3.0:1787096514.965256:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096514.965258:0:6479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096514.965280:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b43841 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965304:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096514.965312:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9c9d6b3f0100) 00010000:00010000:3.0:1787096514.965314:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096514.965317:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3a00, rc 0) 00000100:00100000:3.0:1787096514.965371:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d748bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:24278:x1873906352819328:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 828us (949us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787096514.965378:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:1.0:1787096514.966970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096514.967008:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352819584 00000100:00100000:2.0:1787096514.967017:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352819584 00000100:00100000:2.0:1787096514.967063:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:2.0:1787096514.967073:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:24278:x1873906352819584:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096514.967110:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096514.967133:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ae2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.967193:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.967202:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.967208:0:6480:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.967233:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.967242:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 16 pid: 6479 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096514.967251:0:6480:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6480:1873906360223872:192.168.203.27@tcp:104: 00000100:00100000:2.0:1787096514.967312:0:6480:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e81ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096514.968545:0:6480:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6480:1873906360223872:192.168.203.27@tcp:104: 00010000:00010000:2.0:1787096514.968578:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096514.968722:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096514.968834:0:6466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352819712 00000100:00100000:2.0:1787096514.968841:0:6466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352819712 00010000:00010000:2.0:1787096514.968884:0:6466:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 17 pid: 6479 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096514.968974:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:1.0:1787096514.968991:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+17:2402:x1873906352819712:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096514.969007:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096514.969015:0:8378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 17 pid: 6479 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.969033:0:8378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 17 pid: 6479 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.969056:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43856 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6adb expref: 17 pid: 6479 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.969077:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9c9d6b3f0100) 00010000:00010000:1.0:1787096514.969094:0:8378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.969120:0:8378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.969129:0:8378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096514.969162:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096514.969187:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969200:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096514.969217:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 0 00000100:00100000:1.0:1787096514.969239:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+16:2402:x1873906352819712:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 251us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096514.969250:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00010000:00010000:2.0:1787096514.969343:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969364:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969371:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969378:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096514.969382:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969420:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969441:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff9c9d6b3f0100) 00010000:00010000:2.0:1787096514.969444:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096514.969449:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969455:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b4386b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969496:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43864 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ae2 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969505:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55a00) 00010000:00010000:2.0:1787096514.969513:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096514.969517:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b43864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ae2 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096514.969529:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4ac00, rc 0) 00000100:00100000:2.0:1787096514.969578:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:24278:x1873906352819584:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2506us (2611us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096514.969586:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:1.0:1787096514.970912:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096514.970967:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352819968 00000100:00100000:0.0:1787096514.970976:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352819968 00000100:00100000:0.0:1787096514.971014:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:0.0:1787096514.971022:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+14:24278:x1873906352819968:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1787096514.971200:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:24278:x1873906352819968:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 178us (293us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1787096514.971208:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00010000:00010000:1.0:1787096515.278647:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096515.486053:0:18375:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_5b: @@@@@@ FAIL: setstripe failed 00000100:00100000:1.0:1787096515.791765:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787096515.791786:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d748b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360224000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787096515.791847:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096515.791888:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360224000 00000100:00100000:2.0:1787096515.791896:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360224000 00000100:00100000:2.0:1787096515.791938:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787096515.791947:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360224000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096515.791978:0:7409:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787096515.792041:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360224000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096515.792058:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787096515.792108:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d748b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360224000:0@lo:41:osp-pre-1-0.0 Debug log: 454 lines, 454 kept, 0 dropped, 0 bad.