00010000:00010000:2.0F:1746155031.738805:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1746155032.741645:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1746155032.772569:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122619776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155032.772624:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155032.772646:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122619776 00000100:00100000:1.0:1746155032.772653:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122619776 00000100:00100000:1.0:1746155032.772684:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1746155032.772690:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976122619776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746155032.772718:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1746155032.772749:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976122619776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155032.772754:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1746155032.772827:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122619776:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1746155033.315665:0:9870:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967336 is committed 00000001:00080000:0.0:1746155033.315678:0:9870:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000001:00080000:0.0:1746155033.315700:0:9870:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00000001:00080000:0.0:1746155033.315707:0:9870:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000001:00080000:3.0F:1746155033.603628:0:8525:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000001:00080000:3.0:1746155033.603665:0:8525:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00010000:00010000:2.0:1746155033.743036:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746155034.744706:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746155034.853642:0:7125:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967660 is committed 00000001:02000400:1.0:1746155035.247325:0:18228:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 0j: test lfs mirror read/write commands ========================================================== 23:03:55 (1746155035) 00000100:00100000:1.0:1746155035.279928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.279998:0:7076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117567232 00000100:00100000:3.0:1746155035.280009:0:7076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117567232 00000100:00100000:3.0:1746155035.280419:0:7076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 961 00000100:00100000:3.0:1746155035.280427:0:7076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+15:14436:x1830976117567232:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155035.280446:0:7076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155035.280462:0:7076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c85e00/0x844e5faceb5a4934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef7977 expref: -99 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.280531:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280541:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280549:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280558:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280562:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280566:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280679:0:7076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280684:0:7076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280689:0:7076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280703:0:7076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095179600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.280706:0:7076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280711:0:7076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280720:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093e07f00) 00010000:00010000:3.0:1746155035.280723:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155035.280726:0:7076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280730:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095179600/0x844e5faceb5a493b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280738:0:7076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280742:0:7076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280746:0:7076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280749:0:7076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c285800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.280751:0:7076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280755:0:7076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280760:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.280762:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155035.280769:0:7076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280773:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c285800/0x844e5faceb5a4942 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.280808:0:7076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c85e00/0x844e5faceb5a4934 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7977 expref: 16 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.280815:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c85e00/0x844e5faceb5a4934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7977 expref: 16 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.280822:0:7076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c85e00, rc 0) 00000100:00080000:1.0:1746155035.280925:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155035.282910:0:7076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+15:14436:x1830976117567232:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2477us (2983us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155035.282921:0:7076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 961 00000100:00100000:0.0:1746155035.287753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.288126:0:7076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117567488 00000100:00100000:2.0:1746155035.288135:0:7076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117567488 00000100:00100000:2.0:1746155035.288184:0:7076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 962 00000100:00100000:2.0:1746155035.288191:0:7076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+15:14436:x1830976117567488:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155035.288207:0:7076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155035.288210:0:7076:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155035.288232:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc1200/0x844e5faceb5a46b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef78ac expref: 15 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.288245:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093e07f00) 00010000:00010000:2.0:1746155035.288253:0:7076:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155035.288262:0:7076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95800/0x844e5faceb5a4949 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef797e expref: -99 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.288376:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288385:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288393:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288401:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288406:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288411:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288945:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288952:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288958:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00000004:00200000:2.0:1746155035.288965:0:7076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00010000:00010000:2.0:1746155035.288981:0:7076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288987:0:7076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288992:0:7076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.288996:0:7076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3f94c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155035.289000:0:7076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.289005:0:7076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.289011:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093e01e00) 00010000:00010000:2.0:1746155035.289014:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155035.289016:0:7076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:2.0:1746155035.289020:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f94c00/0x844e5faceb5a4950 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00000004:00010000:2.0:1746155035.289036:0:7076:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009352a680 reply state ffff88009a07e000 transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00000100:00100000:2.0:1746155035.289042:0:7076:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746155035.289060:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95800/0x844e5faceb5a4949 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 17 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.289072:0:7076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 16 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.289078:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e01000) 00010000:00010000:2.0:1746155035.289080:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155035.289082:0:7076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c84000, rc 0) 00000100:00100000:2.0:1746155035.289128:0:7076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14436:x1830976117567488:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 936us (1382us total) trans 4294967661 rc 0/0 00000100:00100000:2.0:1746155035.289134:0:7076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 962 00010000:00010000:3.0:1746155035.291102:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.291113:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.291118:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.291124:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3f95000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.291127:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.291132:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.291143:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880093e01b00) 00010000:00010000:3.0:1746155035.291150:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155035.291154:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.291158:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95000/0x844e5faceb5a4957 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00000100:00100000:0.0:1746155035.291941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.291984:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117567744 00000100:00100000:2.0:1746155035.291992:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117567744 00000100:00100000:2.0:1746155035.292028:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 963 00000100:00100000:2.0:1746155035.292034:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+16:14436:x1830976117567744:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155035.292052:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155035.292066:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c85e00/0x844e5faceb5a496c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef7985 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.292143:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.292153:0:8472:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 17 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.292164:0:8472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.292189:0:8472:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 17 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.292199:0:8472:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 17 pid: 7076 timeout: 264 lvb_type: 0 00000100:00100000:2.0:1746155035.292209:0:8472:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009becd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122619904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155035.292278:0:8472:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155035.295706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.295773:0:8472:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009becd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122619904:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155035.295792:0:8472:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:2.0:1746155035.295929:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117567872 00000100:00100000:2.0:1746155035.295935:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117567872 00010000:00010000:2.0:1746155035.295959:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 18 pid: 7076 timeout: 264 lvb_type: 0 00000100:00100000:2.0:1746155035.295994:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 204 00000100:00100000:2.0:1746155035.296000:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:1961:x1830976117567872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155035.296011:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155035.296016:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 18 pid: 7076 timeout: 264 lvb_type: 0 00010000:00010000:2.0:1746155035.296025:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 18 pid: 7076 timeout: 264 lvb_type: 0 00010000:00010000:2.0:1746155035.296044:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84000/0x844e5faceb5a495e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef797e expref: 18 pid: 7076 timeout: 264 lvb_type: 0 00010000:00010000:2.0:1746155035.296062:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e01000) 00010000:00010000:2.0:1746155035.296065:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.296072:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.296078:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.296102:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155035.296136:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:1961:x1830976117567872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 135us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155035.296142:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 204 00010000:00010000:3.0:1746155035.296186:0:8472:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296192:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:3.0:1746155035.296206:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00080000:3.0:1746155035.296448:0:8472:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00000004:00080000:3.0:1746155035.296456:0:8472:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:3.0:1746155035.296591:0:8472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296599:0:8472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296604:0:8472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296608:0:8472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3f95e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.296612:0:8472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296617:0:8472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296631:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e01000) 00010000:00010000:3.0:1746155035.296633:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155035.296635:0:8472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296639:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f95e00/0x844e5faceb5a4973 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.296678:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c85e00/0x844e5faceb5a496c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7985 expref: 17 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.296683:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c85e00/0x844e5faceb5a496c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7985 expref: 17 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.296691:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c85e00, rc 0) 00000100:00100000:3.0:1746155035.296709:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+16:14436:x1830976117567744:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4676us (4772us total) trans 4294967662 rc 301/301 00000100:00100000:3.0:1746155035.296715:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 963 00000100:00100000:2.0:1746155035.299975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.300129:0:15055:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117568128 00000100:00100000:3.0:1746155035.300138:0:15055:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117568128 00000100:00100000:3.0:1746155035.300186:0:15055:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 230 00000100:00100000:3.0:1746155035.300193:0:15055:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+16:14436:x1830976117568128:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155035.300462:0:15055:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14436:x1830976117568128:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 269us (494us total) trans 4294967663 rc 0/0 00000100:00100000:3.0:1746155035.300468:0:15055:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 230 00000100:00100000:1.0:1746155035.303577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.303669:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117568384 00000100:00100000:0.0:1746155035.303677:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117568384 00000100:00100000:0.0:1746155035.303865:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 231 00000100:00100000:0.0:1746155035.303873:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14436:x1830976117568384:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155035.304670:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14436:x1830976117568384:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 795us (1097us total) trans 4294967664 rc 0/0 00000100:00100000:0.0:1746155035.304678:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 231 00000100:00100000:0.0:1746155035.315945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.316680:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117568512 00000100:00100000:3.0:1746155035.316688:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117568512 00000100:00100000:3.0:1746155035.316728:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 964 00000100:00100000:3.0:1746155035.316742:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14447:x1830976117568512:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:3.0:1746155035.316762:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155035.316778:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8c00/0x844e5faceb5a4981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef798c expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.316828:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8600/0x844e5faceb5a4988 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.316837:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8600/0x844e5faceb5a4988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.316846:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8600/0x844e5faceb5a4988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:3.0:1746155035.316894:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 11776 00000004:00200000:3.0:1746155035.316897:0:8472:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155035.316910:0:8472:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8600/0x844e5faceb5a4988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.316928:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8c00/0x844e5faceb5a4981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef798c expref: 20 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.316939:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8600/0x844e5faceb5a4988 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef798c expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.316947:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093e06900) 00010000:00010000:3.0:1746155035.316949:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746155035.316952:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc8600, rc 0) 00000100:00100000:3.0:1746155035.317003:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14447:x1830976117568512:12345-192.168.202.51@tcp:101:cp.0 Request processed in 263us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.317009:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 964 00000100:00100000:0.0:1746155035.320944:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.321027:0:7076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117568640 00000100:00100000:3.0:1746155035.321035:0:7076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117568640 00000100:00100000:3.0:1746155035.321086:0:7076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 965 00000100:00100000:3.0:1746155035.321094:0:7076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14447:x1830976117568640:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:3.0:1746155035.321108:0:7076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155035.321122:0:7076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a498f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef7993 expref: -99 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.321169:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321179:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321187:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321197:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321202:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321206:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321281:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321287:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321292:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00000004:00200000:3.0:1746155035.321337:0:7076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00200000:3.0:1746155035.321342:0:7076:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155035.321353:0:7076:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321362:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321367:0:7076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321372:0:7076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321377:0:7076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321382:0:7076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5cc8200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.321385:0:7076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321391:0:7076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321399:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093e06900) 00010000:00010000:3.0:1746155035.321402:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155035.321405:0:7076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321410:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8200/0x844e5faceb5a4996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321418:0:7076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321427:0:7076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321431:0:7076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321435:0:7076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5cc9600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.321438:0:7076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321442:0:7076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321447:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880093e06f00) 00010000:00010000:3.0:1746155035.321449:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155035.321451:0:7076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321455:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5a499d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7076 initiator: MDT0 00010000:00010000:3.0:1746155035.321477:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a498f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 21 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.321486:0:7076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 20 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.321491:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.321493:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155035.321494:0:7076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc9a00, rc 0) 00000100:00100000:3.0:1746155035.321552:0:7076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+20:14447:x1830976117568640:12345-192.168.202.51@tcp:101:cp.0 Request processed in 459us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.321562:0:7076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 965 00000100:00100000:2.0:1746155035.325377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.330518:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117568768 00000100:00100000:3.0:1746155035.330529:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117568768 00000100:00100000:3.0:1746155035.330586:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 229 00000100:00100000:3.0:1746155035.330593:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:1961:x1830976117568768:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:3.0:1746155035.330607:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155035.330624:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef799a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155035.330645:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1746155035.330659:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.330661:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.330667:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155035.330682:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155035.330692:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c84000, rc 0) 00000100:00100000:3.0:1746155035.330736:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:1961:x1830976117568768:12345-192.168.202.51@tcp:101:cp.0 Request processed in 145us (5368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.330742:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 229 00000100:00080000:0.0:1746155035.335540:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155035.338591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.338650:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117569024 00000100:00100000:2.0:1746155035.338658:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117569024 00000100:00100000:2.0:1746155035.338696:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 966 00000100:00100000:2.0:1746155035.338703:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+20:14447:x1830976117569024:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:2.0:1746155035.338718:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155035.338732:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5a49b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79a1 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.338808:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.338819:0:8472:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 21 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.338834:0:8472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.338858:0:8472:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 21 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.338868:0:8472:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 21 pid: 7076 timeout: 264 lvb_type: 0 00000100:00100000:2.0:1746155035.338879:0:8472:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009becd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155035.338933:0:8472:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155035.342042:0:8472:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009becd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620032:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155035.342048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155035.342063:0:8472:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:1.0:1746155035.342128:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117569152 00000100:00100000:1.0:1746155035.342136:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117569152 00010000:00010000:1.0:1746155035.342177:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 22 pid: 7076 timeout: 264 lvb_type: 0 00000100:00100000:1.0:1746155035.342207:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 205 00000100:00100000:1.0:1746155035.342214:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+22:1960:x1830976117569152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155035.342226:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155035.342232:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 22 pid: 7076 timeout: 264 lvb_type: 0 00010000:00010000:1.0:1746155035.342243:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 22 pid: 7076 timeout: 264 lvb_type: 0 00010000:00010000:1.0:1746155035.342269:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a49a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef7993 expref: 22 pid: 7076 timeout: 264 lvb_type: 0 00010000:00010000:1.0:1746155035.342281:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:1.0:1746155035.342285:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:1.0:1746155035.342292:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:1.0:1746155035.342298:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:1.0:1746155035.342323:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155035.342365:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:1960:x1830976117569152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 150us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155035.342371:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 205 00010000:00010000:2.0:1746155035.342491:0:8472:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.342498:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:2.0:1746155035.342538:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00010000:00010000:2.0:1746155035.342654:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5a49b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 22 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.342668:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 21 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.342675:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.342685:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155035.342688:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131346000, rc 0) 00000100:00100000:2.0:1746155035.342729:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:14447:x1830976117569024:12345-192.168.202.51@tcp:101:cp.0 Request processed in 4025us (4143us total) trans 4294967665 rc 0/0 00000100:00100000:2.0:1746155035.342736:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 966 00000100:00100000:0.0:1746155035.346409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.346556:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117569408 00000100:00100000:0.0:1746155035.346565:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117569408 00000100:00100000:0.0:1746155035.346611:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 967 00000100:00100000:0.0:1746155035.346619:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:14447:x1830976117569408:12345-192.168.202.51@tcp:36:cp.0 00010000:00010000:0.0:1746155035.346999:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:0.0:1746155035.347017:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:0.0:1746155035.347028:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000001:00080000:0.0:1746155035.347073:0:8472:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967666 00000004:00010000:0.0:1746155035.347092:0:8472:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cd8c380 reply state ffff88009c794000 transno 4294967667 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:0.0:1746155035.347099:0:8472:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746155035.347177:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+24:14447:x1830976117569408:12345-192.168.202.51@tcp:36:cp.0 Request processed in 558us (773us total) trans 4294967667 rc 0/0 00000100:00100000:0.0:1746155035.347183:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 967 00000020:00080000:0.0:1746155035.347188:0:8472:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746155035.351109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155035.351171:0:7076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117569536 00010000:00010000:3.0:1746155035.351181:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00000100:00100000:1.0:1746155035.351183:0:7076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117569536 00010000:00010000:3.0:1746155035.351191:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.351206:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.351211:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db1e000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.351215:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.351221:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8472 initiator: MDT0 00000100:00100000:1.0:1746155035.351236:0:7076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 968 00010000:00010000:3.0:1746155035.351237:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.351244:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746155035.351245:0:7076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+24:14447:x1830976117569536:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:3.0:1746155035.351248:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.351252:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e000/0x844e5faceb5a49c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:1.0:1746155035.351270:0:7076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155035.351406:0:7076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd88400/0x844e5faceb5a49ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79a8 expref: -99 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.351466:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd88400/0x844e5faceb5a49ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a8 expref: 24 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.351479:0:7076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd88400/0x844e5faceb5a49ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a8 expref: 24 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.351500:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:1.0:1746155035.351521:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155035.351524:0:7076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd88400, rc 0) 00000100:00100000:1.0:1746155035.351585:0:7076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+24:14447:x1830976117569536:12345-192.168.202.51@tcp:101:cp.0 Request processed in 340us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155035.351591:0:7076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 968 00000100:00100000:1.0:1746155035.355022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.355077:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117569792 00000100:00100000:0.0:1746155035.355086:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117569792 00000100:00100000:0.0:1746155035.355137:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 969 00000100:00100000:0.0:1746155035.355144:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+24:14447:x1830976117569792:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:0.0:1746155035.355165:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155035.355168:0:8472:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155035.355199:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd88400/0x844e5faceb5a49ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a8 expref: 24 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.355217:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:0.0:1746155035.355220:0:8472:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155035.355233:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1fe00/0x844e5faceb5a49d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79af expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.355295:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e800/0x844e5faceb5a49dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:0.0:1746155035.355307:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e800/0x844e5faceb5a49dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:0.0:1746155035.355327:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e800/0x844e5faceb5a49dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000040:00080000:1.0:1746155035.355830:0:8472:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 88 off9136 00000004:00080000:1.0:1746155035.355837:0:8472:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 164505333893ns, next at 0ns, rc = 0 00000040:00080000:1.0:1746155035.355885:0:8472:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 88 off9176 00000004:00080000:1.0:1746155035.355889:0:8472:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164505385932ns, next at 146182248410ns, rc = 0 00010000:00010000:1.0:1746155035.391912:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e800/0x844e5faceb5a49dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79af expref: 26 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.391935:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:1.0:1746155035.391938:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155035.391959:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1fe00/0x844e5faceb5a49d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79af expref: 26 pid: 8472 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746155035.391975:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e800/0x844e5faceb5a49dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79af expref: 25 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.392009:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:1.0:1746155035.392011:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155035.392013:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db1e800, rc 0) 00000100:00100000:1.0:1746155035.392083:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+25:14447:x1830976117569792:12345-192.168.202.51@tcp:101:cp.0 Request processed in 36937us (37068us total) trans 4294967668 rc 0/0 00000100:00100000:1.0:1746155035.392103:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 969 00000001:00080000:1.0:1746155035.392135:0:7125:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967667 is committed 00000001:00080000:1.0:1746155035.392148:0:7125:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00000004:00080000:1.0:1746155035.392152:0:7125:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:1.0:1746155035.392159:0:7125:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000100:00100000:0.0:1746155035.392231:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122620288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155035.392278:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155035.392293:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122620288 00000100:00100000:2.0:1746155035.392301:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122620288 00000100:00100000:0.0:1746155035.392340:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746155035.392345:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1746155035.392346:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122620160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155035.392353:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1830976122620288:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746155035.392355:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155035.392367:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155035.392380:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122620160 00000100:00100000:3.0:1746155035.392384:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122620160 00000100:00100000:3.0:1746155035.392406:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1746155035.392411:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1830976122620160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155035.392412:0:8437:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1746155035.392419:0:8437:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:3.0:1746155035.392588:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746155035.392592:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746155035.392594:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155035.392595:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746155035.392597:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746155035.392601:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3297:x1830976122620288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (324us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1746155035.392607:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1746155035.392619:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1830976122620160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (251us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1746155035.392622:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:0.0:1746155035.392626:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009becf100, transno 4294967332 00000100:00100000:3.0:1746155035.392631:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000004:00080000:0.0:1746155035.392632:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca96680, transno 4294967335 00000004:00080000:0.0:1746155035.392634:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca96a00, transno 4294967336 00000004:00080000:0.0:1746155035.392636:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca95180, transno 4294967338 00000004:00080000:0.0:1746155035.392639:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca95c00, transno 4294967339 00000100:00100000:0.0:1746155035.392644:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009a6d8380 x1830976122620288/t4294967340(4294967340) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155051 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00080000:3.0:1746155035.392645:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746155035.392653:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d8380/2, rc 0, transno 4294967340 00000100:00100000:0.0:1746155035.392657:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122620288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155035.392667:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967346 gen 2 00000004:00080000:0.0:1746155035.392669:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a46680, transno 4294967341 00000004:00080000:0.0:1746155035.392686:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a47100, transno 4294967342 00000004:00080000:0.0:1746155035.392689:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a44e00, transno 4294967343 00000004:00080000:0.0:1746155035.392691:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a44000, transno 4294967344 00000004:00080000:0.0:1746155035.392694:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009352ad80, transno 4294967345 00000004:00080000:0.0:1746155035.392696:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009352b100, transno 4294967346 00000100:00100000:0.0:1746155035.392700:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009cd8ed80 x1830976122620160/t4294967347(4294967347) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155051 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746155035.392706:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd8ed80/2, rc 0, transno 4294967347 00000100:00100000:0.0:1746155035.392709:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122620160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155035.392925:0:10589:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 5 done 00000004:00080000:2.0:1746155035.393058:0:9500:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 6 done 00000100:00100000:0.0:1746155035.396781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.396814:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117569920 00000100:00100000:0.0:1746155035.396823:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117569920 00000100:00100000:0.0:1746155035.396878:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 232 00000100:00100000:0.0:1746155035.396886:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14447:x1830976117569920:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:0.0:1746155035.396905:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155035.396922:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79b6 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.396955:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155035.396962:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155035.396964:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155035.396967:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.396995:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 19 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155035.397017:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 19 pid: 8438 timeout: 264 lvb_type: 1 00000100:00100000:0.0:1746155035.397029:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976122620416:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155035.397110:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155035.401213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.401428:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976122620416:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155035.401461:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.401479:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c84200, rc 0) 00000100:00100000:0.0:1746155035.401556:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14447:x1830976117569920:12345-192.168.202.51@tcp:101:cp.0 Request processed in 4669us (4784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155035.401564:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 232 00000100:00100000:3.0:1746155035.401726:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117570048 00000100:00100000:3.0:1746155035.401733:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117570048 00010000:00010000:3.0:1746155035.401764:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 19 pid: 8438 timeout: 264 lvb_type: 1 00000100:00100000:3.0:1746155035.401788:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 206 00000100:00100000:3.0:1746155035.401794:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:1962:x1830976117570048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155035.401806:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155035.401811:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 19 pid: 8438 timeout: 264 lvb_type: 1 00010000:00010000:3.0:1746155035.401822:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 19 pid: 8438 timeout: 264 lvb_type: 1 00010000:00010000:3.0:1746155035.401844:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c84000/0x844e5faceb5a49ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef799a expref: 19 pid: 8438 timeout: 264 lvb_type: 1 00010000:00010000:3.0:1746155035.401854:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.401856:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.401861:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.401869:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.401912:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155035.401924:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976122620544:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155035.401975:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155035.409549:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.409638:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976122620544:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155035.409660:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155035.410907:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:1962:x1830976117570048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9108us (9700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155035.410907:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117570176 00000100:00100000:2.0:1746155035.410917:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117570176 00000100:00100000:3.0:1746155035.410919:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 206 00002000:00010000:2.0:1746155035.410973:0:8442:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/30 (0->18446744073709551615) 00002000:00100000:2.0:1746155035.410977:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db480 with x1830976117570176 ext(0->18446744073709551615) 00002000:00010000:2.0:1746155035.410989:0:8442:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6db480. 00000100:00100000:2.0:1746155035.411011:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 23 00000100:00100000:2.0:1746155035.411018:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:1960:x1830976117570176:12345-192.168.202.51@tcp:10:cp.0 00002000:00010000:2.0:1746155035.411284:0:8442:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746155035.411286:0:8442:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1746155035 00002000:00010000:2.0:1746155035.411288:0:8442:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155035.411290:0:8442:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1746155035 00002000:00010000:2.0:1746155035.411292:0:8442:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746155035.411356:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:1960:x1830976117570176:12345-192.168.202.51@tcp:10:cp.0 Request processed in 337us (1815us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1746155035.411362:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 23 00002000:00010000:2.0:1746155035.411365:0:8442:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/30 (0->18446744073709551615) 00002000:00100000:2.0:1746155035.411367:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db480 with x1830976117570176 ext(0->18446744073709551615) 00002000:00010000:2.0:1746155035.411371:0:8442:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6db480. 00000100:00100000:1.0:1746155035.414816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.415325:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117570304 00000100:00100000:2.0:1746155035.415339:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117570304 00000100:00100000:2.0:1746155035.415389:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 970 00000100:00100000:2.0:1746155035.415397:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14447:x1830976117570304:12345-192.168.202.51@tcp:101:cp.0 00010000:00010000:2.0:1746155035.415421:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155035.415440:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3a00/0x844e5faceb5a49ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79bd expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.415669:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.415682:0:8472:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 18 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.415689:0:8472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.415720:0:8472:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 18 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.415731:0:8472:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 18 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:2.0:1746155035.415757:0:8472:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009becd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620672:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155035.415962:0:8472:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155035.419448:0:8472:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009becd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620672:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155035.419476:0:8472:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:1.0:1746155035.419955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.420120:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117570432 00000100:00100000:3.0:1746155035.420127:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117570432 00010000:00010000:3.0:1746155035.420158:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:3.0:1746155035.420597:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 207 00000100:00100000:3.0:1746155035.420604:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:1960:x1830976117570432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155035.420618:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155035.420624:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.420635:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.420656:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131346000/0x844e5faceb5a49b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79a1 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.420779:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.420784:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.420794:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.420804:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.420835:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155035.420866:0:8472:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.420874:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:2.0:1746155035.420917:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 2 00000004:00200000:2.0:1746155035.420921:0:8472:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155035.420936:0:8472:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.420973:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3a00/0x844e5faceb5a49ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.420990:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 18 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.420997:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.420999:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155035.421001:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3aa000, rc 0) 00000100:00100000:3.0:1746155035.421189:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:1960:x1830976117570432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 584us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155035.421189:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14447:x1830976117570304:12345-192.168.202.51@tcp:101:cp.0 Request processed in 5792us (6384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.421196:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 207 00000100:00100000:2.0:1746155035.421205:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 970 00000100:00100000:0.0:1746155035.426065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.426239:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117570688 00000100:00100000:2.0:1746155035.426252:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117570688 00000100:00100000:2.0:1746155035.426379:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 232 00000100:00100000:2.0:1746155035.426388:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14447:x1830976117570688:12345-192.168.202.51@tcp:35:cp.0 00000100:00100000:2.0:1746155035.427213:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14447:x1830976117570688:12345-192.168.202.51@tcp:35:cp.0 Request processed in 826us (1154us total) trans 4294967669 rc 0/0 00000100:00100000:2.0:1746155035.427220:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 232 00000100:00100000:0.0:1746155035.437547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.437694:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117570816 00000100:00100000:2.0:1746155035.437706:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117570816 00000100:00100000:2.0:1746155035.437766:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 971 00000100:00100000:2.0:1746155035.437776:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14449:x1830976117570816:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155035.437807:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155035.437827:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3ab600/0x844e5faceb5a49f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79c4 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.437900:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.437914:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.437924:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.437937:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.437943:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.437958:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438075:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438081:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438086:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:2.0:1746155035.438118:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746155035.438122:0:8472:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155035.438135:0:8472:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438143:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438150:0:8472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438156:0:8472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438162:0:8472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438167:0:8472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f046600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155035.438171:0:8472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438177:0:8472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438192:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093e06900) 00010000:00010000:2.0:1746155035.438195:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155035.438198:0:8472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438203:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a49ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438927:0:8472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438934:0:8472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438939:0:8472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438944:0:8472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f046200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155035.438946:0:8472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438951:0:8472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438959:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880093e01600) 00010000:00010000:2.0:1746155035.438961:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155035.438963:0:8472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438967:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046200/0x844e5faceb5a4a06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.438998:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3ab600/0x844e5faceb5a49f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79c4 expref: 20 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.439015:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79c4 expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.439021:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.439023:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155035.439026:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f046800, rc 0) 00000100:00100000:2.0:1746155035.439703:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14449:x1830976117570816:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1925us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155035.439711:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 971 00000100:00100000:1.0:1746155035.443002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.443177:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117570944 00000100:00100000:3.0:1746155035.443185:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117570944 00000100:00100000:3.0:1746155035.443228:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7 00000100:00100000:3.0:1746155035.443236:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:1960:x1830976117570944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155035.443247:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155035.443268:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79c4 expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.443284:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.443287:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155035.443339:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:1960:x1830976117570944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.443347:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7 00000100:00100000:0.0:1746155035.443570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.444295:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117571200 00000100:00100000:2.0:1746155035.444300:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117571200 00000100:00100000:2.0:1746155035.444346:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 972 00000100:00100000:2.0:1746155035.444352:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14449:x1830976117571200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155035.444364:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155035.444374:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046a00/0x844e5faceb5a4a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79cb expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.444442:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.444452:0:8472:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.444458:0:8472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.444480:0:8472:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.444500:0:8472:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:2.0:1746155035.444612:0:8472:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009becd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620800:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155035.445047:0:8472:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155035.446156:0:8472:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009becd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620800:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155035.446173:0:8472:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:0.0:1746155035.446775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.446841:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117571328 00000100:00100000:3.0:1746155035.446847:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117571328 00010000:00010000:3.0:1746155035.446868:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 20 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:3.0:1746155035.446888:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 208 00000100:00100000:3.0:1746155035.446895:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+20:1960:x1830976117571328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155035.446903:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155035.446908:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 20 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.446916:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 20 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.446933:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3aa000/0x844e5faceb5a49f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79bd expref: 20 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.446946:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.446950:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.446958:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.446963:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.446987:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155035.447027:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:1960:x1830976117571328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 131us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.447043:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 208 00010000:00010000:2.0:1746155035.447235:0:8472:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.447241:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:2.0:1746155035.447256:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00010000:00010000:2.0:1746155035.447374:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046a00/0x844e5faceb5a4a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 20 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.447400:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.447406:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.447408:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155035.447410:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f047e00, rc 0) 00000100:00100000:2.0:1746155035.447441:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14449:x1830976117571200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3089us (3871us total) trans 4294967670 rc 0/0 00000100:00100000:2.0:1746155035.447447:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 972 00000100:00100000:0.0:1746155035.449423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.449489:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117571456 00000100:00100000:2.0:1746155035.449495:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117571456 00000100:00100000:3.0:1746155035.449738:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 973 00000100:00100000:3.0:1746155035.449746:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14449:x1830976117571456:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155035.449762:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155035.449776:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a4a29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79d2 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.450237:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.450247:0:8472:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 20 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.450252:0:8472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.450272:0:8472:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 20 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.450279:0:8472:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 20 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:3.0:1746155035.450286:0:8472:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620928:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155035.450368:0:8472:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155035.452375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.452453:0:8472:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8472:1830976122620928:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155035.452471:0:8472:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:1.0:1746155035.452806:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117571584 00000100:00100000:1.0:1746155035.452812:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117571584 00010000:00010000:1.0:1746155035.452838:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 21 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:1.0:1746155035.452872:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 209 00000100:00100000:1.0:1746155035.452878:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:1960:x1830976117571584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155035.453056:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155035.453062:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 21 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:1.0:1746155035.453071:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 21 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:1.0:1746155035.453090:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f047e00/0x844e5faceb5a4a1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79cb expref: 21 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:1.0:1746155035.453119:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:1.0:1746155035.453129:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:1.0:1746155035.453136:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:1.0:1746155035.453143:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8472 initiator: MDT0 00010000:00010000:1.0:1746155035.453174:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155035.453208:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+20:1960:x1830976117571584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 330us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155035.453214:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 209 00010000:00010000:2.0:1746155035.454143:0:8472:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.454151:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:2.0:1746155035.454188:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746155035.454191:0:8472:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155035.454204:0:8472:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.454230:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5a4a29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79d2 expref: 20 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.454260:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79d2 expref: 19 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.454265:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.454268:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155035.454270:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc9e00, rc 0) 00000100:00100000:2.0:1746155035.454306:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14449:x1830976117571456:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4561us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155035.454322:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 973 00000100:00100000:0.0:1746155035.458324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.459343:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117571840 00000100:00100000:2.0:1746155035.459351:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117571840 00000100:00100000:2.0:1746155035.459417:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 974 00000100:00100000:2.0:1746155035.459425:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14449:x1830976117571840:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155035.459439:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155035.459461:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79d9 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.459549:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046000/0x844e5faceb5a4a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.459560:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046000/0x844e5faceb5a4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.459569:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046000/0x844e5faceb5a4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00200000:2.0:1746155035.459578:0:8472:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00010000:00010000:2.0:1746155035.459665:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046800/0x844e5faceb5a4a37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79d9 expref: 22 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.459678:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046000/0x844e5faceb5a4a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79d9 expref: 21 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.459685:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.459687:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155035.459690:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f046000, rc 0) 00000100:00100000:2.0:1746155035.460289:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:14449:x1830976117571840:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 863us (1984us total) trans 4294967671 rc 0/0 00000100:00100000:2.0:1746155035.460295:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 974 00000100:00100000:1.0:1746155035.465240:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.466062:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117571968 00000100:00100000:0.0:1746155035.466070:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117571968 00000100:00100000:0.0:1746155035.466661:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 233 00000100:00100000:0.0:1746155035.466669:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:1961:x1830976117571968:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155035.466717:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.466733:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.466739:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155035.466741:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155035.466743:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.466771:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.466782:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 19 pid: 18270 timeout: 264 lvb_type: 0 00000100:00100000:0.0:1746155035.466793:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976122621056:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155035.467152:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155035.470642:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976122621056:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155035.470667:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155035.471046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.471996:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117572096 00000100:00100000:0.0:1746155035.472004:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117572096 00002000:00100000:0.0:1746155035.472041:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1e:0x0] (0->158) req@ffff88009ca95c00 x1830976117572096/t0(0) o4->1d16cf7a-13b4-48f0-aa43-a82702b0d605@192.168.202.51@tcp:106/0 lens 648/0 e 0 to 0 dl 1746155046 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:0.0:1746155035.472050:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976117572096 ext(0->158) 00010000:00010000:0.0:1746155035.472057:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 20 pid: 18270 timeout: 264 lvb_type: 0 00010000:00010000:0.0:1746155035.472080:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 20 pid: 18270 timeout: 264 lvb_type: 0 00002000:00010000:0.0:1746155035.472085:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95c00 00000100:00100000:0.0:1746155035.472118:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 2 00000100:00100000:0.0:1746155035.472125:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+20:1960:x1830976117572096:12345-192.168.202.51@tcp:4:cp.0 00000100:00100000:0.0:1746155035.472526:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+22:1960:x1830976117572096:12345-192.168.202.51@tcp:4:cp.0 Request processed in 377us (1456us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1746155035.472532:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 2 00002000:00100000:0.0:1746155035.472537:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1e:0x0] (0->158) req@ffff88009ca95c00 x1830976117572096/t4294967349(0) o4->1d16cf7a-13b4-48f0-aa43-a82702b0d605@192.168.202.51@tcp:106/0 lens 648/448 e 0 to 0 dl 1746155046 ref 1 fl Complete:H/200/0 rc 0/0 job:'cp.0' uid:0 gid:0 00002000:00100000:0.0:1746155035.472543:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976117572096 ext(0->158) 00010000:00010000:0.0:1746155035.472547:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 22 pid: 18270 timeout: 264 lvb_type: 0 00010000:00010000:0.0:1746155035.472555:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 22 pid: 18270 timeout: 264 lvb_type: 0 00002000:00010000:0.0:1746155035.472559:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95c00 00000100:00100000:0.0:1746155035.475980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.476033:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117572224 00000100:00100000:3.0:1746155035.476041:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117572224 00010000:00010000:3.0:1746155035.476071:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 22 pid: 18270 timeout: 264 lvb_type: 0 00000100:00100000:3.0:1746155035.476864:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 210 00000100:00100000:3.0:1746155035.476873:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+22:1963:x1830976117572224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155035.476884:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155035.476899:0:7064:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 159 00010000:00010000:3.0:1746155035.476904:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 22 pid: 18270 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.476915:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 22 pid: 18270 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.476932:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c84200/0x844e5faceb5a49e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79b6 expref: 22 pid: 18270 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.477246:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.477248:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.477252:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.477260:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.477290:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155035.477393:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477401:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477424:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477431:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477437:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477442:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b150400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155035.477446:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477452:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477462:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.477467:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155035.477570:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:1963:x1830976117572224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 697us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.477578:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 210 00000100:00100000:0.0:1746155035.478126:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1d16cf7a-13b4-48f0-aa43-a82702b0d605+20:1961:x1830976117571968:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11457us (12891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155035.478133:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 233 00000100:00100000:3.0:1746155035.481857:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.481919:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117572480 00000100:00100000:2.0:1746155035.481935:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117572480 00000100:00100000:2.0:1746155035.481986:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 975 00000100:00100000:2.0:1746155035.481994:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:14449:x1830976117572480:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155035.482033:0:8472:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746155035.482055:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5a4a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79d2 expref: 21 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.482077:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db1e800/0x844e5faceb5a49dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79af expref: 20 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.482087:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.482090:0:8472:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155035.482113:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.482121:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.482128:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000040:00080000:2.0:1746155035.483971:0:8472:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 88 off9224 00000004:00080000:2.0:1746155035.483981:0:8472:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 164633477460ns, next at 0ns, rc = 0 00000040:00080000:2.0:1746155035.484023:0:8472:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 88 off9264 00000004:00080000:2.0:1746155035.484027:0:8472:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164633524070ns, next at 146182248410ns, rc = 0 00000001:00080000:1.0:1746155035.514608:0:7125:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967672 is committed 00000004:00080000:1.0:1746155035.514617:0:7125:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:1.0:1746155035.514624:0:7125:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000100:00100000:1.0:1746155035.514717:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122621312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155035.514767:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155035.514818:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746155035.514823:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122621184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155035.514840:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155035.514862:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122621312 00000100:00100000:1.0:1746155035.514868:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122621312 00000100:00100000:1.0:1746155035.514893:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122621184 00000100:00100000:1.0:1746155035.514895:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122621184 00000100:00100000:1.0:1746155035.514908:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746155035.514913:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3296:x1830976122621312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155035.515072:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3296:x1830976122621312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (304us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1746155035.515088:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746155035.515102:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1746155035.515106:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3296:x1830976122621184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155035.515202:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3296:x1830976122621184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (359us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1746155035.515207:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000004:00080000:1.0:1746155035.515236:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca96680/2, rc 0, transno 4294967341 00000100:00100000:1.0:1746155035.515240:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122621184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155035.515247:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca96a00/2, rc 0, transno 4294967350 00000100:00100000:1.0:1746155035.515250:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122621312:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746155035.515329:0:8472:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012fe8df80 reply state ffff880094618000 transno 4294967672 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:2.0:1746155035.515338:0:8472:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746155035.515400:0:8472:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746155035.515410:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14449:x1830976117572480:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 33416us (33558us total) trans 4294967672 rc 0/0 00000100:00100000:2.0:1746155035.515421:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 975 00010000:00010000:3.0:1746155035.515605:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.515613:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.515619:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.515625:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f046600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.515629:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.515634:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.515647:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.515650:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155035.515652:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.515657:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046600/0x844e5faceb5a4a53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00000100:00100000:1.0:1746155035.528824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.528971:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117572608 00000100:00100000:0.0:1746155035.528987:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117572608 00000100:00100000:0.0:1746155035.529027:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 976 00000100:00100000:0.0:1746155035.529034:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+16:14449:x1830976117572608:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155035.529051:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155035.529067:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79e0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.529112:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 17 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.529124:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 17 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.529138:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:0.0:1746155035.529140:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155035.529143:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c84200, rc 0) 00000100:00100000:0.0:1746155035.529195:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14449:x1830976117572608:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 161us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155035.529200:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 976 00000100:00100000:0.0:1746155035.531927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.532059:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117572736 00000100:00100000:2.0:1746155035.532066:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117572736 00000100:00100000:1.0:1746155035.533332:0:7076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 977 00000100:00100000:1.0:1746155035.533344:0:7076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14449:x1830976117572736:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155035.533363:0:7076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155035.533381:0:7076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1c200/0x844e5faceb5a4a61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79e7 expref: -99 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.533448:0:7076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1da00/0x844e5faceb5a4a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7076 initiator: MDT0 00010000:00010000:1.0:1746155035.533458:0:7076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1da00/0x844e5faceb5a4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7076 initiator: MDT0 00010000:00010000:1.0:1746155035.533467:0:7076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1da00/0x844e5faceb5a4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00000004:00200000:1.0:1746155035.533487:0:7076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:1.0:1746155035.533499:0:7076:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155035.533530:0:7076:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1da00/0x844e5faceb5a4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7076 initiator: MDT0 00010000:00010000:1.0:1746155035.533551:0:7076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1c200/0x844e5faceb5a4a61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e7 expref: 19 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.533566:0:7076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1da00/0x844e5faceb5a4a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e7 expref: 18 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155035.533572:0:7076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:1.0:1746155035.533575:0:7076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155035.533577:0:7076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e1da00, rc 0) 00000100:00100000:1.0:1746155035.533637:0:7076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14449:x1830976117572736:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 296us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155035.533643:0:7076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 977 00000100:00100000:2.0:1746155035.535681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.536269:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117572864 00000100:00100000:3.0:1746155035.536277:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117572864 00000100:00100000:3.0:1746155035.536323:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 236 00000100:00100000:3.0:1746155035.536332:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+20:1961:x1830976117572864:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155035.536345:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155035.536369:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79ee expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155035.536389:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 159, mtime: 0x6814361b, atime: 0x0, ctime: 0x6814361b, blocks: 0x1 00010000:00010000:3.0:1746155035.536403:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.536405:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.536411:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155035.536424:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155035.536432:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095194c00, rc 0) 00000100:00100000:3.0:1746155035.536807:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:1961:x1830976117572864:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 475us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.536813:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 236 00000100:00100000:0.0:1746155035.541386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.541456:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117573120 00000100:00100000:2.0:1746155035.541464:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117573120 00000100:00100000:2.0:1746155035.541533:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 978 00000100:00100000:2.0:1746155035.541540:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14449:x1830976117573120:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155035.541581:0:8472:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155035.541601:0:8472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e1da00/0x844e5faceb5a4a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e7 expref: 18 pid: 7076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.541616:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:2.0:1746155035.541619:0:8472:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155035.541649:0:8472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.541657:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:2.0:1746155035.541664:0:8472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000004:00010000:2.0:1746155035.541931:0:8472:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cd8c700 reply state ffff880094523000 transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8472 initiator: MDT0 00000100:00100000:2.0:1746155035.541936:0:8472:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155035.542007:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:14449:x1830976117573120:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 467us (628us total) trans 4294967673 rc 0/0 00000100:00100000:2.0:1746155035.542012:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 978 00010000:00010000:3.0:1746155035.545154:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.545166:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.545172:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.545177:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b150400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155035.545180:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.545187:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.545214:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.545217:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155035.545220:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00010000:00010000:3.0:1746155035.545225:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8472 initiator: MDT0 00000100:00100000:0.0:1746155035.545945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.546079:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117573248 00000100:00100000:3.0:1746155035.546087:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117573248 00000100:00100000:3.0:1746155035.546137:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 237 00000100:00100000:3.0:1746155035.546144:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:14449:x1830976117573248:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155035.546156:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155035.546167:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095194800/0x844e5faceb5a4a7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79f5 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.546189:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155035.546195:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.546197:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.546200:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095194800/0x844e5faceb5a4a7d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79f5 expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.546226:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155035.546238:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 22 pid: 8438 timeout: 264 lvb_type: 1 00000100:00100000:3.0:1746155035.546255:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976122621440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155035.547454:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155035.547813:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976122621440:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155035.547831:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095194800/0x844e5faceb5a4a7d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79f5 expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.547843:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095194800, rc 0) 00000100:00100000:3.0:1746155035.547883:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+22:14449:x1830976117573248:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1739us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.547890:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 237 00000100:00100000:0.0:1746155035.548225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.548703:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117573376 00000100:00100000:3.0:1746155035.548708:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117573376 00010000:00010000:3.0:1746155035.548727:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 22 pid: 8438 timeout: 264 lvb_type: 1 00000100:00100000:3.0:1746155035.548748:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 211 00000100:00100000:3.0:1746155035.548753:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+22:1961:x1830976117573376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155035.548761:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155035.548778:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 22 pid: 8438 timeout: 264 lvb_type: 1 00010000:00010000:3.0:1746155035.548786:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 22 pid: 8438 timeout: 264 lvb_type: 1 00010000:00010000:3.0:1746155035.549010:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095194c00/0x844e5faceb5a4a6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79ee expref: 22 pid: 8438 timeout: 264 lvb_type: 1 00010000:00010000:3.0:1746155035.549019:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.549021:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155035.549024:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095194800/0x844e5faceb5a4a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79f5 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.549031:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095194800/0x844e5faceb5a4a7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79f5 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155035.549053:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095194800/0x844e5faceb5a4a7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79f5 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155035.549062:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976122621568:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155035.549131:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155035.551441:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976122621568:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155035.551462:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155035.551528:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:1961:x1830976117573376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2750us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155035.551537:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 211 00000100:00100000:0.0:1746155035.551898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.552229:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117573504 00000100:00100000:3.0:1746155035.552235:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117573504 00000100:00100000:3.0:1746155035.552355:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 238 00000100:00100000:3.0:1746155035.552363:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+21:1961:x1830976117573504:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155035.552625:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:3.0:1746155035.552628:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 1746155035 -> 1746155035 00002000:00010000:3.0:1746155035.552631:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1746155035 00002000:00010000:3.0:1746155035.552633:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 1746155035 -> 1746155036 00002000:00010000:3.0:1746155035.552634:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746155035.552766:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+22:1961:x1830976117573504:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 403us (868us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1746155035.552772:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 238 00000100:00100000:0.0:1746155035.554151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.554201:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117573760 00000100:00100000:2.0:1746155035.554207:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117573760 00000100:00100000:2.0:1746155035.554248:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 233 00000100:00100000:2.0:1746155035.554254:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ed6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:14449:x1830976117573760:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:2.0:1746155035.554296:0:7079:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000401:0x22:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046000/0x844e5faceb5a4a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79d9 expref: 18 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.554347:0:7079:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7079 initiator: MDT0 00010000:00010000:2.0:1746155035.554358:0:7079:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 18 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.554364:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7079 initiator: MDT0 00010000:00010000:2.0:1746155035.554388:0:7079:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 18 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155035.554399:0:7079:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 18 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:2.0:1746155035.554409:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009becf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7079:1830976122621696:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155035.554561:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155035.555877:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009becf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7079:1830976122621696:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155035.555898:0:7079:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7079 initiator: MDT0 00000100:00100000:0.0:1746155035.556371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155035.556448:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117573888 00000100:00100000:3.0:1746155035.556453:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117573888 00010000:00010000:3.0:1746155035.556479:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00000100:00100000:3.0:1746155035.556532:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 212 00000100:00100000:3.0:1746155035.556539:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+19:1960:x1830976117573888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155035.556551:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155035.556556:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.556566:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.556581:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c84200/0x844e5faceb5a4a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79e0 expref: 19 pid: 8472 timeout: 264 lvb_type: 0 00010000:00010000:3.0:1746155035.556593:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.556597:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.556608:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.556614:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.556636:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155035.556672:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d16cf7a-13b4-48f0-aa43-a82702b0d605+18:1960:x1830976117573888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 133us (302us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155035.556672:0:7079:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7079 initiator: MDT0 00000100:00100000:3.0:1746155035.556678:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 212 00010000:00010000:1.0:1746155035.556678:0:7079:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7079 initiator: MDT0 00000040:00080000:1.0:1746155035.557106:0:7079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 88 off9312 00000004:00080000:1.0:1746155035.557111:0:7079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 164706608258ns, next at 0ns, rc = 0 00000040:00080000:1.0:1746155035.557160:0:7079:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 88 off9352 00000004:00080000:1.0:1746155035.557163:0:7079:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164706659827ns, next at 146182248410ns, rc = 0 00000001:00080000:0.0:1746155035.573661:0:7125:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000004:00080000:0.0:1746155035.573667:0:7125:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000004:00080000:0.0:1746155035.573679:0:7125:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000004:00010000:0.0:1746155035.573710:0:7079:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a6ed6450 reply state ffff88012df67800 transno 4294967674 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7079 initiator: MDT0 00000100:00100000:0.0:1746155035.573721:0:7079:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746155035.573728:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:0.0:1746155035.573731:0:7079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155035.573738:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f046000/0x844e5faceb5a4a3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79d9 expref: 16 pid: 8472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155035.573792:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009becf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122621824:0@lo:2:osp-syn-1-0.0 00010000:00080000:0.0:1746155035.573818:0:7079:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746155035.573827:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ed6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+16:14449:x1830976117573760:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 19572us (19677us total) trans 4294967674 rc 0/0 00000100:00100000:1.0:1746155035.573831:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155035.573835:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 233 00000100:00100000:0.0:1746155035.573954:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976122621952:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155035.573957:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.573966:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.573972:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.573977:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b150400 already unused, calling callback (ffffffffa135a690) 00000100:00100000:0.0:1746155035.573977:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155035.573981:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.573986:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7079 initiator: MDT0 00000100:00100000:2.0:1746155035.573988:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122621824 00000100:00100000:2.0:1746155035.573993:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122621824 00010000:00010000:3.0:1746155035.573996:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093e06d00) 00010000:00010000:3.0:1746155035.573998:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155035.574001:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7079 initiator: MDT0 00010000:00010000:3.0:1746155035.574004:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b150400/0x844e5faceb5a4a84 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7079 initiator: MDT0 00000100:00100000:2.0:1746155035.574014:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122621952 00000100:00100000:2.0:1746155035.574016:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122621952 00000100:00100000:0.0:1746155035.574024:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1746155035.574028:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1746155035.574031:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3298:x1830976122621952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155035.574031:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3297:x1830976122621824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155035.574177:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976122621824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (344us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1746155035.574182:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000004:00080000:1.0:1746155035.574197:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009becf480/2, rc 0, transno 4294967342 00000100:00100000:1.0:1746155035.574202:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009becf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122621824:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155035.574341:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:2.0:1746155035.574344:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 1746155035 -> 1746155035 00002000:00010000:2.0:1746155035.574346:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 1746155035 -> 1746155035 00002000:00010000:2.0:1746155035.574348:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 1746155036 -> 1746155036 00002000:00010000:2.0:1746155035.574349:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746155035.574370:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976122621952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 338us (392us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1746155035.574375:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000004:00080000:0.0:1746155035.574382:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451d880/2, rc 0, transno 4294967352 00000100:00100000:0.0:1746155035.574386:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976122621952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155035.576943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.576999:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117574016 00000100:00100000:0.0:1746155035.577013:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117574016 00000100:00100000:0.0:1746155035.577061:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 979 00000100:00100000:0.0:1746155035.577068:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+15:14449:x1830976117574016:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155035.577086:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155035.577103:0:8472:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd89e00/0x844e5faceb5a4a8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86ef79fc expref: -99 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.577173:0:8472:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd89e00/0x844e5faceb5a4a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79fc expref: 16 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.577186:0:8472:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd89e00/0x844e5faceb5a4a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86ef79fc expref: 16 pid: 8472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155035.577198:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8800a5eec600) 00010000:00010000:0.0:1746155035.577201:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155035.577204:0:8472:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd89e00, rc 0) 00000100:00100000:0.0:1746155035.577273:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+16:14449:x1830976117574016:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 205us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155035.577279:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 979 00000100:00100000:0.0:1746155035.581799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.581892:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117574272 00000100:00100000:2.0:1746155035.581900:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117574272 00000100:00100000:2.0:1746155035.581937:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 234 00000100:00100000:2.0:1746155035.581944:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+16:14449:x1830976117574272:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155035.582230:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d16cf7a-13b4-48f0-aa43-a82702b0d605+17:14449:x1830976117574272:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 285us (457us total) trans 4294967675 rc 0/0 00000100:00100000:2.0:1746155035.582237:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 234 00000100:00100000:2.0:1746155035.599685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155035.599731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155035.599826:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117574528 00000100:00100000:0.0:1746155035.599833:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117574528 00000100:00100000:0.0:1746155035.599891:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 50 00000100:00100000:0.0:1746155035.599898:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+14:1963:x1830976117574528:12345-192.168.202.51@tcp:400:kworker.0 00000100:00080000:3.0:1746155035.599926:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155035.599956:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d16cf7a-13b4-48f0-aa43-a82702b0d605+14:1963:x1830976117574528:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155035.600412:0:7072:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976117574400 00000100:00100000:1.0:1746155035.600416:0:7072:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976117574400 00000100:00100000:1.0:1746155035.600440:0:7072:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 232 00000100:00100000:1.0:1746155035.600446:0:7072:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac3a7642-de88-4ed3-b89e-97bc2d762ccf+9:1963:x1830976117574400:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155035.600473:0:7072:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ac3a7642-de88-4ed3-b89e-97bc2d762ccf+9:1963:x1830976117574400:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 27us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155035.600479:0:7072:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 232 00000100:00100000:0.0:1746155035.600623:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 50 00010000:00010000:2.0:1746155035.746965:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155036.162817:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3295:1830976122622080:0@lo:400:kworker.0 00000100:00100000:0.0:1746155036.162894:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155036.163046:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830976122622208:0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163084:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155036.163105:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122622720:0@lo:400:kworker.0 00000100:00100000:2.0:1746155036.163118:0:7073:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122622080 00000100:00100000:2.0:1746155036.163126:0:7073:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122622080 00000100:00100000:1.0:1746155036.163127:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155036.163140:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746155036.163144:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1830976122622592:0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163159:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155036.163174:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976122622336:0@lo:400:kworker.0 00000100:00100000:2.0:1746155036.163175:0:7073:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1746155036.163182:0:7073:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3295:x1830976122622080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163189:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155036.163223:0:7073:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3295:x1830976122622080:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155036.163229:0:7073:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1746155036.163246:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746155036.163250:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122622464:0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163266:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155036.163285:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122622208 00000100:00100000:1.0:1746155036.163286:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122622720 00000100:00100000:2.0:1746155036.163288:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122622208 00000100:00100000:1.0:1746155036.163293:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122622720 00000100:00100000:2.0:1746155036.163316:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122622592 00000100:00100000:2.0:1746155036.163317:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122622592 00000100:00100000:1.0:1746155036.163325:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122622464 00000100:00100000:1.0:1746155036.163327:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122622464 00000100:00100000:1.0:1746155036.163342:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1746155036.163344:0:8472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122622336 00000100:00100000:2.0:1746155036.163346:0:8472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122622336 00000100:00100000:1.0:1746155036.163347:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976122622720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155036.163357:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1746155036.163362:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830976122622208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163380:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976122622720:12345-0@lo:400:kworker.0 Request processed in 32us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155036.163387:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830976122622208:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155036.163393:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1746155036.163393:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1746155036.163401:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1746155036.163405:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976122622592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163405:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1746155036.163409:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976122622464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155036.163421:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976122622592:12345-0@lo:400:kworker.0 Request processed in 16us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155036.163426:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1746155036.163436:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976122622464:12345-0@lo:400:kworker.0 Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155036.163439:0:8472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1746155036.163441:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1746155036.163443:0:8472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976122622336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155036.163461:0:8472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976122622336:12345-0@lo:400:kworker.0 Request processed in 18us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155036.163465:0:8472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1746155036.163479:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122622464:0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163487:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976122622336:0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163529:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1830976122622592:0@lo:400:kworker.0 00000100:00080000:3.0:1746155036.163533:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155036.163535:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976122622720:0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.163542:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830976122622208:0@lo:400:kworker.0 00000100:00100000:0.0:1746155036.163600:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3295:1830976122622080:0@lo:400:kworker.0 00000100:00100000:1.0:1746155036.196660:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122622848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746155036.196738:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155036.196802:0:10389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976122622848 00000100:00100000:1.0:1746155036.196810:0:10389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976122622848 00000100:00100000:1.0:1746155036.196846:0:10389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1746155036.196853:0:10389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976122622848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746155036.196890:0:10389:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1746155036.196924:0:10389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976122622848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155036.196930:0:10389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1746155036.196970:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976122622848:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1746155036.294545:0:18339:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_0j: @@@@@@ FAIL: resync /mnt/lustre/f0j.sanity-flr failed 00010000:00010000:1.0:1746155036.750361:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1133 lines, 1133 kept, 0 dropped, 0 bad.